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Abstract 

The approach of an ideal gas to equilibrium is simulated through a gen- 
eralization of the Ehrenfest ball-and-box model. In the present model, the 
interior of each box is discretized, i.e., balls/particles live in cells whose oc- 
cupation can be either multiple or single. Moreover, particles occasionally 
undergo random, but elastic, collisions between each other and against the 
container walls. I show, both analitically and numerically, that the number 
and energy of particles in a given box eventually evolve to an equilibrium 
distribution W which, depending on cell occupations, is binomial or hy- 
pergeometric in the particle number and beta-like in the energy. Further- 
more, the long-run probability density of particle velocities is Maxwellian, 
whereas the Boltzmann entropy In W exactly reproduces the ideal-gas en- 
tropy. Besides its own interest, this exercise is also relevant for pedagogical 
purposes since it provides, although in a simple case, an explicit probabilis- 
tic foundation for the ergodic hypothesis and for the maximum-entropy 
principle of thermodynamics. For this reason, its discussion can profitably 
be included in a graduate course on statistical mechanics. 

PACS numbers: 02.50. Ga, 02.50.Ng, 05.20.Dd 

KEY WORDS: Urn models; Maxwell-Boltzmann velocity distribution; Boltz- 
mann entropy. 
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1 Introduction 



After the pioneering work of Boltzmann, there is now a general consensus on 
the idea that a dynamically chaotic motion generically leads, in systems of very 
many particles, to thermodynamic behaviour. A general proof of this statement 
is however lacking, and one's intuition usTially appeals to simplified dynamical 
models which allow for some analytic treatment. Statistical toy-models that 
illustrate how thermodynamic equilibrium is established in practice are especially 
helpful for educational scope, since they supply students with a plain justification 
and a direct understanding of the basic assumptions of thermodynamics and 
statistical mechanics. In particular, an intuitive picture of the emergence of the 
Second Law of thermodynamics from mechanics is provided by the behaviour 
of stochastic urn models, where balls/particles arc subjected to a probabilistic 
evolution which, eventually, drives the system towards a stationary state [1]. 
Obviously, this stochastic (Markovian) dynamics is only a caricature of the "real" 
(Newtonian) dynamics; it is much like an effective dynamics which emerges after 
averaging over many instances of the complicated short-time motion. 

In the Ehrenfest model, numbered balls are distributed into two urns; at 
each time step, a number between 1 and A^ is extracted at random, and the ball 
with that label is moved from the urn where it resides to the other. Eventually, 
the average number of balls in each urn becomes equal to N/2, with relative fluc- 
tuations around the mean that are negligible in the large- A^ limit. This stochastic 
process, which Kac considered as "probably one of the most instructive models 
in the whole of Physics" [2], gives an illustration of the irreversible diffusive dy- 
namics of two dilute gases of the same species, hosted in two communicating, but 
globally isolated, vessels of equal volume. As we learn from thermodynamics, 
and is confirmed by experience, the two gases eventually attain an equilibrium 
state being characterized by an equal number of particles in the two vessels. 

In order to include also energetic considerations into the description, I consider 
a generalization of the Ehrenfest model where the balls/particles are endowed 
with both a discrete position and a continuous velocity. To be specific, we are 
given two boxes, 1 and 2, and A^ labelled particles distributed between the boxes. 
Box 1 (2) is divided into Vi (V2) identical cells, V = Vi + V2 being the total cell 
number. The occupation number Cq of the a-th cell {a = 1, . . . ,V) can be either 
Bose-like (c^ = 0, 1, 2, . . .) or Fermi-like (cq, = 0, 1), with both possibilities being 
considered in the following. The velocity of the a-th particle (a = 1, . . . , A^) is 
Va, a three-dimensional vector with components Vak, k = 1,2,3. 

To make some progress in the analytic treatment of the model, a drastic 
simplification is made, namely that the position dynamics is totally decoupled 
from the velocity dynamics. This is obtained by an independent and alternate 
updating of positions and velocities, in such a way that free diffusive motion and 
collisions will run in parallel, yet staying separate. In particular, the equilibrium 
of one set of variables can be analysed without making reference to the other. The 
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assumption of decoupling between position and velocity updating is tantamount 
to the hypothesis that 1) the Markov time step, while being much longer than any 
microscopic collision time, is nevertheless shorter than the time needed for the 
velocity distribution to relax {i.e., to reach equilibrium); 2) velocity relaxation 
occurs on a time scale that is also well separated from (typically much longer 
than) the equilibration time of the number density. 

I argue, and indeed is verified a posteriori, that this model gives a representa- 
tion of the ideal-gas dynamics once defining the entropy with the logarithm of the 
probability density of macrostate variables. Hence, by this route one arrives at a 
novel {i.e., not based on the microcanonical ensemble) microscopic foundation of 
the ideal-gas expression for the entropy and, at the same time, at a probabilistic 
justification of the maximum-entropy principle of thermodynamics. Furthermore, 
this simple model gives the opportunity to discuss at length the issue of ergod- 
icity of a probabilistic evolution and its relevance for the actual deterministic 
dynamics of a many-particle system. This point is usually hardly understood by 
graduate students in statistical physics, who find it rather obscure. The present 
model could come in useful for providing an easy access to such basic theoretical 
questions. 

The outline of this paper is the following: in Sections 2 and 4, 1 describe the 
stochastic dynamics of particle positions and velocities, respectively. Section 3 
is an intermezzo, mainly of illustrative value, where I show an example of exact 
derivation of a macro-variable (coarse-grained) evolution from the microscopic 
dynamics. Further comments and conclusions are given in Section 5. 



2 Update of positions 

Let us first suppose that each cell in the boxes can host whatever number of 
particles. A positions update consists of 1) choosing at random one particle, Ur, 
and one cell, a^; and 2) moving particle into cell q;^. In terms of the macro- 
variable n, which counts how many particles are currently found in box 1, this 
defines a stationary stochastic process of the Markov type, being characterized 
by the following conditional (or transition) probabilities: 

T{n + l^n) = P{n + l;t + l\n-t)= ~y^' ; 
T{n-l^n) = P{n-l;t+l\n;t)^^. (1) 

In Eq. (1), i = 0, 1, 2, ... is a discrete time. The ensuing master equation for n 
reads: 
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It is immediate to realize, by direct inspection, that Eq. (2) admits the bino- 
mial distribution 

-<")^(-:)(^)"(^)""" 

as unique stationary distribution. Since the Markov chain is ergodic {i.e., there is 
a path connecting every (macro)state n to every other n'), any initial distribution 
P{n;0) will converge, in the long run, to W{n). Observe that W{n) gives the 
chance that, upon randomly distributing N labelled particles into two boxes, with 
different a priori probabilities for the boxes, the number of particles in box 1 be 
n. Moreover, the multiplicity of macrostate n, i.e., the number of complexions 
(microstates) of N distinguishable particles in the boxes, such that box 1 contains 
n particles, is V^W{n). Hereafter, I list a number of properties which hold for 
the dynamics ruled by Eq. (2). 

First, I calculate the average n and at any time by explicitly evaluating 
the two sums 

^ V / 1 \ 

{n){t + l) ^ X:nP(n;t + l) = ^+(l--j(n)(t); 

n^){t + l) = Y.n'^P{n;t + l) 

n=0 



V 



in) it) . (4) 



The first of the difference equations (4) admits a solution (n) (t) — a + bx^, for 
suitable a, b, and x. One easily finds: 

(„),).^,((„)(o)-^)(:-^)', ,5) 

i.e., an irreversible exponential approach to NVi/V, a value corresponding to 
having the same density of particles in every box. Similarly, the second of Eqs. (4) 
has a solution of the form 

«^)W=a' + 6'(l-l)' + c'(l-l)', (6) 

with a' = NVi/V + A^(A^ — l){Vi/V)^. Whence the variance of n scales, in the 
infinite-time limit, as N: 



^{n') - {nf 1 



(n) VN\ Vi 



(7) 



4 



Assuming n, N — n,Vi,V2 — 0{N) » 1 and using the Stirling approximation 
InA^! = A^(lnA^ — 1) + 0{\nN), the cquihbrium entropy S{n), defined as the 
logarithm of the multiplicity V^W{n), turns out to be additive over the boxes 
and extensive with n: 

71 ]W — 71 

S{n)r.-n\n—-{N-n)hi—— + NlaN, (8) 
Vi V2 

being maximum for n = NVi/V (subextensive terms in (8) are ignored). Note 
that the superextensive iVln term turns into an extensive constant if V'^WIti) 
is multiplied by the Gibbs factor of whose origin is quantum- mechanical (it 
arises as a required correction to the partition function of a system of identical 
particles in the classical limit, i.e., under the hypothesis of low particle density 
at all temperatures). In Eq(8), we recognize the volume contribution to the 
ideal-gas entropy. Therefore, the equilibrium (and asymptotic) value of n is the 
outcome of the entropy maximization, as indeed prescribed by thermodynamics. 

It easily follows from Eq. (3) that the profile of W{ri) around the maximum 
is Gaussian, 

An = n — NVi/V being the deviation from the abscissa of the maximum. The 
last term in Eq. (9) is negligible for standard deviations An = 0{\/N). 

Nothing changes in the asymptotics if ar is forbidden to be the same original 
cell of ttr- In this case, 

but the form of W{n) is unchanged. However, 



V V' " ' V y \ N{v-i] 

is slightly different from (5), though sharing the same limit NVi/V for t 00. 

While all of the above sounds quite "standard", novel results are those 1 
obtain for the case of single-occupation cells. Now, at each step of the process, 
the selected particle is moved into a cell that is chosen at random among 
the vacant sites. The transition probabilities now read (with 14, V2 > N): 

^ ^ N{V-N) ' ^ ^ N{V-N) ' ^ ^ 

yielding a hypergeometric stationary distribution for variable n: 

«»-f!T'r'lf/\V (13) 
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The Vandermonde identity, 



N 

E 

n=0 



n 



. N , 



(14) 



ensures that Eq. (13) is normahzed correctly. W{n) gives the chance that, upon 
randomly choosing N cells (i.e., the occupied ones) among a total of V distin- 
guishable sites, the number of particles in box 1 be n. Stated it differently, 
is the number of ways n numbered particles can be sorted out from a set of A^", 
while 



ViVi-l Vi-{n- 1) V2 V2-I 



VV-l V -{n-l) V -nV -{n + l) 



V2-{N-n-l) 
V -{N -I) 



(15) 



is the number of ways these n particles can be allocated in box 1 (the other 



N — n being attributed to box 2 instead). The product of (^^j by (15) gives 
again W{n). Finally, the multiplicity of state n, i.e., the number of ways N 
indistinguishable particles can be arranged into V distinguishable cells, in such 



a way that n particles reside in box 1, is equal to (^^^ 
The average n and at time t are given by: 



(n) (t) 



NVi 



+ (0) 



V2 

N-n 



V 



W{n). 



n^){t) = a' + b'il 



V 



N{V - N) 



+ c' 1- 



2{V - 



N{V - N) 



(16) 



with a' = [NV1V2 + N^ViiVi - 1)] / [V{V - 1)]. In the infinite-time limit, the 
relative deviation from the average 



in) 



V2{V-N) 

y/N\ Vi{V-l) 



[17) 



Upon assuming n, N — n,Vi — n,V2 — N + n — 0{N) ^ 1, the equilibrium 
entropy becomes: 



S{n) = In 



. n , 



' V2 ^ 



n 



—n In — — [Vi — n) In ( 1 — — 



n 



N — 11 / 
- {N-n) In — {V2-N + n)\n(l- 



N - 



being maximum for n = NVi/V. Equation (18) is nothing but the thermody- 
namic entropy of two ideal lattice gases that can mutually exchange energy and 
particles. 
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Finally, it immediately follows from Eq. (13) that the profile of W{n) around 
the maximum is Gaussian, 



An = n — NVi/V being the deviation from the abscissa of the maximum. Again, 
the last two terms in Eq. (19) are negligible for standard deviations An = 0{\/N). 

3 Derivation of a coarse-grained dynamics 
from the microstate dynamics 

For a specific instance of stochastic dynamics of cell occupation numbers, I pro- 
vide in this paragraph the detailed derivation of the coarse-grained evolution of 
a macro- variable {i.e., the number n of occupied cells in box 1). 

In the example considered here, the occupation numbers = 0, 1 arc made to 
evolve according to the following rules: at each time step, 1) two cells are chosen 
at random (either in the same box or in different boxes) , and 2) their occupation 
numbers are mutually - and unconditionally - exchanged (observe that the overall 
number N of occupied cells is conserved by the dynamics). The ensuing Monte 
Carlo/Markovian evolution is thus specified by the transition probabilities 

r{{c'} - {c}) = — ^ E f^c;,c/4,c„ n ^c;,cJ , (20) 

where the constant prefactor in (20) ensures the correct normalization, namely 
that 

E^({c'}-{c}) = l. (21) 

{c'} 

Taken 7r({c}; t) to be the probabihty for the occurrence of the microstate {c} at 
time t, the master equation of micro-evolution formally reads: 

AWh ^ + 1) = E ^iW} - {c}) ^({c}; t) ■ (22) 

{c} 

Upon plugging Eq. (20) into Eq. (22), the latter equation becomes: 

2 

7r(. . . , c„, . . . , C;3, . . . ; t + 1) = _ E • • ' • • • , Ca, . . . ; t) , (23) 

^ ^) a<l3 

which admits the constant (J^^ as a stationary solution. 
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Let the V cells be numbered in such a way that the first Vi cells in the hst do 
belong to box 1, while those from Vi + 1 to 1/ belong to box 2. The probability 
of observing the macrostate n at time t is then 

{c} ^-=^ ^' 

I aim at finding an equation of evolution for this P, namely a master equation 
that is valid at a less fundamental, coarse-grained level of description. 

First, I note that every sum over all distinct pairs of cells (like that appearing 
on the r.h.s. of Eq. (23)) can be decomposed into three sums, J2a<t3<Vi + J2a<Vi<i3 + J2vi<a<i37 
the three partial sums being denoted as A, B, and C, respectively. Also observe 
that, for q; < /3 < ^1 or Vl < q; < /3, the value of n is left unchanged by the 
exchange of and cp, and the same happens for a < Vi < P provided Cq, = C/s. 
Conversely, for a < Vi < P, n increases (or decreases) by 1 when — and 
Cp = 1 (or the other way around). 

Let Sn be the set of all the (^M ( ) microstates {c} such that J2YLi = n. 



n J \N—n ) 

Upon summing the l.h.s. of Eq. (23) over the net result is, by definition, 
P(n; t-\-l). Similarly, summing A and C over the same microstates gives 

Y^Pin-A and iMiW)p(n;«), (25) 

respectively. As to the pairs a < j3 contributing to -B, le., satisfying a <Vi < (3, 
the microstates of Sn are classified in four categories, according to the values of 
Cq and cp. Calling Ha,p the total number of pairs of each type, one has: 



Ca = = 


1 : 


<i = 


n{N 


-n); 




Ca = C/3 = 


: 


<i = 




n){V2-N + n); 




1 and C/j = 


: 


■A/'S = 


n{V2 


-N + n); 




and C/3 — 


1 : 


<i = 




n){N - n) . 


(26) 



In particular, the coefficient of P{n; t) in the master equation for n should be: 

2 fV,{V,-l) , ¥2(^2-1] 



V{V - 1) V 2 2 

2(Vi -n)(N -n) + 2n{V2 -N + n) 



+ n{N - n) + {Vi 



1 - 



V{V-1) 




Now observe that, for each microstate of Sn, there are exactly Af^^p terms in 
the sum Y.a<Vi<i3 '^i- ■ ■ jCp, . . . ,Ca, ■ ■ - 'jt) that refer to microstates of Sn-i- Hence, 
the coefficient of P{n — l;t) in the master equation [i.e., the number of times any 
specific microstate of Sn-i is repeated in the sum Z]{c}e5„ Sa<Vi</3 '^i- ■ ■ -i^p, . . . ,Ca, ■ ■ ■;t)) 
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is given by the product of A/'i^^ times the number of Sn microstates, divided by 
the total number of -S'^-i microstates: 



n{V2-N + n)['^)[ 



N-n 



(:■:)( 



V2 

N-n+1 



^{Vi-n+l){N -n + 1), (28) 



which is also the number of Sn microstates that can be originated from any 
specific microstate of Sn-i by moving a particle from box 2 to 1. 
A similar calculation for the coefficient of P(n + 1; t) yields: 



(V,-n)(N-n){';i) 



V2 

N-u 



{n + l){V2- N + n + l). (29) 



\n+l) \N-n-l) 

In the end, the complete master equation for n reads: 

One can easily extract from the above equation the expression of the transition 
probabilities, with the result: 

nn + l^n)^ ; nn-l^n)^ . (31) 

The latter probabilities, although not identical to the (12), nonetheless lead to 
the same stationary distribution (13), as can be checked directly. This is not 
strange, since the transition probabilities (31) are obtained by multiplying the 
(12) for the constant factor 2N{V - N)/[V{V - 1)]. 



4 Update of velocities 

The collision dynamics of a set of equal-mass particles can be schematized, at 
the roughest level of description, as a succession of random binary events which 
are nevertheless required to obey energy and momentum conservation [3]. On 
the macroscopic side, such collision rules go along with the conservation of total 
kinetic energy and total momentum, thus being appropriate only to a very dilute 
(gaseous) system of particles. If, moreover, we want to drop the momentum 
constraint, provision should be made also for elastic collisions of particles against 
the (cubic) container walls, causing the reversal of one component only of the 
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velocity of the hitting particle (say, the x component if the collision occurs against 
the wall that is orthogonal to the x axis). 

As far as the mutual collisions are concerned, the conservation laws by them- 
selves require that the velocities of the colliding particles, say a and 6, be updated 
as: 

v„ ^ = v„ + (A^;)f ; v;, ^ = v,, - (A^;)f , (32) 

where Ai> = (v^ — Vq) • r, and all that we know about the unit-length vector f is 
that it forms an acute angle with — Vq (i.e.. At; > 0). In particular, note that 
a general property of an elastic collision is: 



(33) 



The full specification of r would require more knowledge about the collision {i.e., 
the peculiar geometry of the impact and the exact law of interaction between the 
particles). Instead, the collision rules considered here are such that the outcome 
of a mutual collision is as maximally random as possible: that is, at each step of 
the game, f is picked up at random from the emisphere of unit vectors forming 
an acute angle with — [4] . Note that in one dimension only is the vector r 
nonetheless univocally determined: this is consistent with the known fact that, 
for particles moving on a straight line and colliding elastically, the conservation 
laws suffice to determine the post-collision velocities from the initial ones. I point 
out that the duration of velocity relaxation in a real system is rather sensitive 
to the peculiarities of the interaction between particles. However, this may not 
be the case for the asymptotic shape of the velocity distribution, which is only 
aware of the conservation laws that rule the outcome of an individual collision. 

If collisions against walls and between particles occur at a rate of 1 — p and p, 
respectively (where p is any number between and 1), the master equation for 
the velocities reads: 



7r({v'};t + 1) = / d^^^r({v'} ^ {v})7r({v}; i) , 



(34) 



where t — {1 — p)ti-\- pT2 and 

1 N 3 

ri({v'}-{v}) = 3T^EE 



r2({v'}-{v}) = 



^) a<b 



{b,l)^(a,k) 

^ 5'(vl + v;-v„-v,)5«^ + ^f 



27r Va - vJ 



X 



n - vc) 

c^o, b 



Note that the two kernels ti and T2 are separately normalized. In particular, 
the factor l/(27r |va — v^l) is the outcome of a six-dimensional integration of 
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delta functions, which is performed by substituting and v|, with the auxihary 
variables s = (v^+v[,)/2 and t = (v(j — v[,)/2 (the jacobian for this transformation 
is 8): 



a ^b) 



J d\; 6%V^ + v; - V, - Vfe) 6{v'^ + v,--v:-v 
8 1 d's dH S'[2s - {Ya + V,)] S[2{s' + e) - {vl + vl 

2 



n+OO 





^2_ /^V„-Vfe 



= 27r |va - Vbl . (36) 

Using Eqs. (33) and (36), it is easy to prove that a stationary solution to 
Eq. (34) is, for any regular and properly normalized function F: 

w{{w}) = F{vl + ■■■ + <). (37) 

An outstanding exception is p = 1, where the more general stationary solution 
to Eq. (34) is instead F{y\ + • • • + v^j) G{yi + • • • + vjv), for arbitrary F and G 
functions. 

Next, I consider the one- and two-body velocity distributions at time t. These 
are marginal distributions that are built over 7r({v};i): 

/i(vi;i) = ydW^^3---dV7r({v};t); 
/2(vi,V2;i) = j d\^...d\NA{^}]t). (38) 

Seeking for an exact equation of evolution for /i, I calculate /i(vi;t + 1) by 
inserting Eq. (34) into the first of Eqs. (38). While the term arising from ri can 
be easily worked out, less straightforward is the derivation of the other one, 
involving T2: 

j d3^2. . .dV / d3Vr2({v} ^ {v'})7r({v'};t) 

X j d\,5\Y,+Y,-V,-V,)5{vl + vl-v'^ -v',^), (39) 

where the latter sum is actually made of — 1 identical contributions. Then, 
considerations similar to those leading to Eq. (36) allow one to further simplify 
the r.h.s. of Eq. (39) and to arrive at the final equation for /i, whose status is 
akin to that of the famous Boltzmann equation in the kinetic theory of gases: 



/i(vi;t + l) = (l-p)|(^l-l)/,(vi;t) 
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+ ^ [fi{-vix, viy, vu; t) + fi{vi^, -viy, vu] t) + fi{vi^, Viy, -Vu 



Vi - 



+ p{(l-l)/,(v,;04xi/d%./d»Ai. 

While it seems problematic to derive a sort of H-theorem from Eq. (40), a more 
easy program to fulfil is to find time-independent solutions for this equation. It is 

immediate to check that the ansatz /2°''''(vi, V2) = ^{vj + V2) gives a stationary 
solution to Eq. (40) for any appropriate function $ (for p = 1, the more general 
time-independent solution is instead ^{vf + t'|)^'(vi -|- V2)). However, in case of 
an isolated system with total energy U [5], the only admissible solution (37) is 
the microcanonical density 

■"({v}) = ^^U-i'^-Mvl + -- + VI-U). (41) 

In this case, the $ function can be explicitly worked out by transforming to 
hyperspherical coordinates: 



/^^(Vl,V2) 



/ d^V, . . . d?VM 5(U - vl - vl - SI3 vl) 

>g3(iv-2)(l) /o^°° ,lrr^^^-^)-Hy -{U-vl- vl)] 
53^(l)/o+°°drr3^-i<5(r2-C/) 

.^^U)-^U-d±A]"^-\ (42) 



r(3(iV-2)/2)' ' V u 

Sn{R) = 27r"/2i?"-7r(n/2) being the area of the n-dimensional hyperspherical 
surface of radius R. A similar calculation leads to: 



3(N-1) 

r(3(A'-l)/2)^-' V' cf. 



,<=..K)^^jm^(.„r'fi-#V""\ (43) 



which is the finite- iV Maxwell-Boltzmann (MB) distribution [6] . In the N,U ^ 00 
limit (with U/N — 0(1)), one recovers from Eq. (43) the more famihar Gaussian 
form: 



3 



/(-)(v)=^Ve-% (44) 



with K, = 3N/{2U), corresponding to an average of U/N for all a. Note that 
full independence of vi and V2, namely f2"^\vi, V2) = /i''^''(vi)/}*^'^''(v2), requires 
the thermodynamic limit N ^ 00 and U — 0{N). 

As a further comment, I emphasize that a distribution like (37) is a meaningful 
solution to Eq. (34) also for F not being a delta function. In fact, the t — 



12 



velocity distribution need not necessarily correspond to a single microstate or to 
a mixture of microstates all having the same energy U. It is an equally valid 
possibility that the initial state encompasses a whole distribution of microstate 
energies. In this case, and taken for granted that the evolution is ergodic, the 
collisions will eventually suppress any difference in weight between the microstates 
having the same energy, but preserving the overall frequency of occurrence of 
every energy value in the mixture. 

A normalized w distribution of the form (37) requires that F satisfies 



Upon observing that 

r+oo 

F{vl + • • . + O = / dUF{U)6{vl + --- + v%-U), (46) 
Jo 



the two- and one-body velocity distributions will read: 



3(Af-l) 

tor,\ TT 2 f+oo 3(Ar-i) 1 

^''"'(^') = r(3(^-l)/2) /; df/f(f/)(f/-.D^-V (47) 



The above distributions have not generally a Gaussian profile, even in the thermo- 
dynamic hmit (an exception is F(U) — 'k~^^/'^ exp(— C/), which leads to /i^''^(vi) = 
7r-3/2exp(-T;2) and f[^''\^^l, V2) = 7r-3exp(-^;2 - vD). 

I have carried out a computer simulation of the evolution encoded in Eq. (34) 
in order to check whether the stationary distribution (43) is also an asymptotic, 
t ^ 00 solution to Eq. (34), as one may surmise (at least for < p < 1) from 
the likely ergodic character of its kernel r. First, I set = 3 and U — 0.06, 
with p — 0.5 (note that the choice of U is rather immaterial, it just sets the 
range of fluctuations of a single velocity component to approximately a value of 



2^U / {?)N)). Starting from a system of velocities in any particular microstate 
of energy U , I collect in a hystogram the values, at regular time intervals, of 
the three components of, say, the velocity of particle 1. A look at Fig. 1 indeed 
shows that this hystogram has, in the long run, the finite-A" MB form. This 
is indirect evidence that the simulation trajectory samples uniformly, at least 
effectively if not literally, the 3A^-dimensional hypersurface of energy U . I note 
that crgodicity does not hold for 7; = {i.e., when collisions against the walls are 
the only present), whereas the stochastic evolution for p = 1 {i.e., only mutual 
collisions present) retains memory of the initial value of the total momentum. 

Afterwards, I take A^ = 1000 and [/ = 20 (i.e., same U/N as in the case 
before), and follow the evolution of the same hystogram as above, now starting 
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from velocity values that are randomly extracted from e.g. a (bounded) uniform 
onc-particic distribution of zero average and variance equal to U/ {•iN) (I have 
checked that nothing changes in the results if the shape of the initial one- velocity 
distribution were different, e.g. truncated quadratic). After discarding the initial 
part of the simulation trajectory, the long-run distribution of values for velocity 
no. 1 now compares well with a Gaussian (see Fig. 2), that is with the large- 
N form of the MB distribution. In fact, also the instantaneous velocities of 
all particles are asymptotically distributed, for large A^, according to the same 
Gaussian (see Fig. 3). This indicates that: 1) the vast majority of points in the 
energy hypersurface is made of "typical" states, i.e., microstates that look more 
or less similar as far as low-order, marginal distributions like /i are concerned; 2) 
the microstate at which the evolution (34) was started is actually untypical; and 
3) this evolution moves eventually the initial state into the manifold of typical 
microstates. It is believed that such features of the stochastic dynamics (34)- (35) 
are owned also by the deterministic dynamics of a typical many-particle system. 
In particular, it is in the weak or effective sense being clarified in point 3) above 
that the ergodic hypothesis of statistical mechanics may actually be relevant for 
mechanical systems (and are the most) that are not strictly ergodic [7]. 

For a given number n of particles in box 1, the equilibrium probability density 

Wn{u) of their total energy u can be calculated exactly for w({v}) oc S{vf H h 

vff — U), by evaluating the probability that the number vl + - ■ • + v^he comprised 
in an interval (a, 6), with a > 0. Once again, this probability is calculated by 
transforming to hyperspherical coordinates: 

Pivl + --- + vle{a,b)) 

Ssn{l)Ss^N-n){l) /^dr r^"-^ /o+°- dpp3(^-")-^(5(p^ + r'-U) 
53iv(l)/o^°°drr3^-i<5(r2-C/) 

r(3n/2) r{3{N - n) /2) ^ Ja ^ ' ' ^ ' 

Hence, the final result: 

^ ' r(3n/2)r(3(Ar-n)/2) ^ ' ' v ; 

that is, the variable u/U is 6eto-distributed with an average otn/N and a variance 

of (n/iV)(l-n/iV)/(3AV2 + l) (which is 0{N-^) for n = 0{N)). Of all n- velocity 
microstates, the fraction of those states whose energy lies between u and u + A-u 
is Wn{u)/S.u (for Am -Cm). In particular, the Boltzmann entropy associated with 
Eq. (49) is, forn, A^ - n = 0{N) > 1: 

3n, n 2>{N-n)^ N-n 3N N 
\nWJu) In ^ ^In \ In — , (50) 
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which, when including also the configurational term (8) or (18), gives back the 
correct expression of the entropy of the (monoatomic) ideal gas: 

S V 3iV, U 

— ^A^ln \ In — . (51) 



5 Conclusions 

Simple, yet non trivial, theoretical models hold a prominent place in our own 
understanding of the physical reality, since they help in corroborating in our mind 
the general abstract principles. This is especially true for the learning of statistical 
mechanics, where the appeal of students to their physical intuition, which is 
grounded on every-day experience, is not as easy as for classical mechanics and 
therefore the convinced acceptance of basic principles by them would require a 
proper mediation. 

An example is the hypothesis of equal a priori probability of all microstates, 
which is crucial for getting at the microcanonical and canonical ensembles. In 
this paper, 1 have introduced a stochastic process of the Ehrenfest type which, 
among other things, provides a microscopic justification for the expression of the 
thermodynamic entropy of an ideal gas, i.e., without relying on any ergodic hy- 
pothesis. Rather, the validity of this hypothesis, at least in an effective sense, 
arises automatically from the stochastic dynamics itself. However, in order to 
make the asymptotics of the present model solvable a rather strong assumption 
was made, i.e., that positions and velocities actually behave as uncorrelated ran- 
dom variables. This is only justified so long as the two sets of variables relax on 
very different time scales, which is a fair assumption only for low-density gases 
{i.e., for particles undergoing only sporadic encounters). The proposed derivation 
of the ideal-gas entropy somehow recalls the heuristic estimate of the multiplicity 
by [8, 9], though being definitely more rigorous. 

In thermodynamics, the Second Law requires the maximizization of the total 
entropy S under the given constraints (here, the total number of particles N and 
the total energy U of two ideal gases being in grand-canonical contact with each 
other) in order to find the equilibrium state of an overall isolated system. In the 
present model, this very same prescription emerges naturally, when defining the 
entropy d la Boltzmann, as the condition upon which the partition of N and U 
between the gases be, in the long-time regime, the (overwhelming for U,N 1) 
most probable. Hopefully, a discussion of this model with the students can serve 
to deepen their comprehension of the hypotheses underlying statistical mechanics. 
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FIGURE CAPTIONS 



Fig. 1 : Numerical simulation of Eq. (34). Top: Hystogram of velocity values 
for particle 1 (A, □, and Q correspond to the x, |/, and z component, 
respectively). Here, N — 3 and U — 0.06. After rejecting a total of 
10^ collisions per particle (CPP) (so as to sweep away any memory of the 
initial state), as many as 10^ CPP are produced. The p value is 0.5, held 
fixed during the simulation. Data (in form of frequencies of occurrence) 

are grouped in bins of width 5v = 2^U/N/31. After equilibration, the 
hystogram is updated every 10 CPP. The full curve is the theoretical, finite- 
N MB distribution per single velocity component, which is appreciably 
different from the infinite- A?" limit {i.e., the Gaussian k/t: ex^{—Kv'^), with 
K — 3N/(2U) - broken curve). Bottom: Here is plotted the difference 
between the hystogram and the finite- A^ MB distribution. 

Fig. 2 : Numerical simulation of Eq. (34). Top: Hystogram of velocity values 
for particle 1 (same symbols and notation as in Fig. 1). Now, A^ = 1000 
and U = 20 {i.e., same U/N as in Fig. 1). Initially, the Va vectors are 
extracted from a uniform one-particle distribution having zero average and 
a variance of U/{3N) (hence the maximum speed fmax = \JU/N). Then, 
velocities are rescaled to fit the chosen U value. After discarding 10^ CPP, 
a huge number of coUisions is performed (10^ per particle, with p — 0.5). 
Similarly to A" = 3, data are grouped in bins of width 5v — 2vinax/31 and 
the hystogram is updated every 10 CPP. The full curve is the theoretical 
distribution, that is the Gaussian n/n exp{—K.v^), with k. = 3N/{2U). 
Bottom: Difference between the hystogram and the above Gaussian. 

Fig. 3 : Numerical simulation of Eq. (34). Top: Particle velocities at the end 
of the simulation run for A^ = 1000 and t/ = 20 (see Fig. 2, caption; same 
symbols and notation as in Fig. 1). The distribution of all- particle velocities 
at a given time strongly resembles the same Gaussian as in Fig. 2 (full 
curve). Bottom: Difference between the above hystogram and this Gaussian 
law (note the change of scale with respect to Figs. 1 and 2). 
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